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Abstract 

W). 

^ . We design a particle interpretation of Feynman-Kac measures on path spaces based 

on a backward Markovian representation combined with a traditional mean field par- 
ticle interpretation of the flow of their final time marginals. In contrast to traditional 
genealogical tree based models, these new particle algorithms can be used to compute 
normalized additive functionals "on-the-fly" as well as their limiting occupation mea- 
sures with a given precision degree that does not depend on the final time horizon. 

We provide uniform convergence results w.r.t. the time horizon parameter as well as 
functional central limit theorems and exponential concentration estimates. We also 
illustrate these results in the context of computational physics and imaginary time 
Schroedinger type partial differential equations, with a special interest in the numer- 
ical approximation of the invariant measure associated to /i-processes. 

Keywords : Feynman-Kac models, mean field particle algorithms, central limit the- 
orems, exponential concentration, non asymptotic estimates. 
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IT) 

(n| ■ 1 Introduction 

00 

O ■ Let (E n ) n >Q be a sequence of measurable spaces equipped with some cr-fields (£ n )n>o, and 
we let V{E n ) be the set of all probability measures over the set E n , with n > 0. We let 
X n be a Markov chain with Markov transition M n on E n , and we consider a sequence 
of (0, l]-valued potential functions G n on the set E n . The Feynman-Kac path measure 
^ associated with the pairs (M n ,G n ) is the probability measure Q n on the product state 

space i£[o,n.] := (Eq x . . . x E Tl ) defined by the following formula 



o 



i I n G P (X P ) l dF n (1.1) 

n \0<p<n J 
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where Z n is a normalizing constant and P n is the distribution of the random paths (^ p )o<p<n 
of the Markov process X p from the origin p = 0, up to the current time p = n. We also 
denote by T n = Z n Q n its unnormalized version. 

These distributions arise in a variety of application areas, including filtering, Bayesian 
inference, branching processes in biology, particle absorption problems in physics and many 
other instances. We refer the reader to the pair of books [U [TO] and references therein. 
Feynman-Kac models also play a central role in the numerical analysis of certain partial 
differential equations, offering a natural way to solve these functional integral models by 
simulating random paths of stochastic processes. These Feynman-Kac models were origi- 
nally presented by Mark Kac in 1949 |12| for continuous time processes. These continuous 
time models are used in molecular chemistry and computational physics to calculate the 
ground state energy of some Hamiltonian operators associated with some potential function 
V describing the energy of a molecular configuration (see for instance [U [T5| I19j . and 
references therein). 

To better connect these partial differential equation models with (jl.ip . let us assume 
that M n (x n -i,dx n ) is the Markov probability transition X n = x n X n +\ = x n+ \ coming 
from a discretization in time X n = X[ n of a continuous time i?-valued Markov process X[ on 
a given time mesh (t n ) n >o with a given time step {t n — = At. For potential functions 
of the form G n = e- yAt ~ the measures Q n — At— >Q Qt„ represents the time discretization of 
the following distribution: 

dQt = Y t ex P (" \l v ( x '») ds ) dF ?' 

where P^' stands for the distribution of the random paths (X' s )o< s <t with a given infinites- 
imal generator L. The marginal distributions 7$ at time t of the unnormalized measures 
2>t dQt are the solution of the so-called imaginary time Schroedinger equation, given in weak 
formulation on every sufficiently regular function / by 

j t ltU)-=lt{L V U)) with L V = L-V 

The errors introduced by the discretization of the time are well understood for regular 
models, we refer the interested reader to [61 [HJ [T4l [T6] in the context of nonlinear filtering. 

In this article, we design an numerical approximation of the distributions Q n based 
on the simulation of a sequence of mean field interacting particle systems. In molecular 
chemistry, these evolutionary type models are often interpreted as a quantum or diffusion 
Monte Carlo model. In this context, particles often are referred as walkers, to distinguish 
the virtual particle-like objects to physical particles, like electrons of atoms. In contrast to 
traditional genealogical tree based approximations (see for instance [1]), the particle model 
presented in this article can approximate additive functionals of the form 

F n (x ,...,X n ) = j— — ^ ( L2 ) 

0<p<n 

uniformly with respect to the time horizon. Moreover this computation can be done "on- 
the-fly". To give a flavor of the impact of these results, we recall that the precision of 
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the algorithm corresponds to the size N of the particle system. If stands for the N- 
particle approximation of Q n , under some appropriate regularity properties, we shall prove 
the following uniform and non asymptotic Gaussian concentration estimates^: 



for any e > 0, and for some finite constant b < oo. In the filtering context, Q„ cor- 
responds to the sequential Monte Carlo approximation of the forward filtering backward 
smoothing recursion. Recently, a theoretical study of this problem was undertaken by [9]. 
Our results complement theirs and we present functional central limit theorems as well as 
non-asymptotic variance bounds. Additionally, we show how the forward filtering backward 
smoothing estimates of additive functionals can be computed using a forward only recur- 
sion. This has applications to online parameter estimation for non-linear non-Gaussian 
state-space models. 

For time homogeneous models (M n , f n , G n ) = (M, /, G) associated with a lower bounded 
potential function G > 5, and a M-reversible transition w.r.t. to some probability measure 
fj, s.t. M(x, .) ~ fi and (M(x, -)/dfj,) 6 IL2 (/^) , it can be established that Q n (F n ) converges 
to Hh(f), as n — > 00, with the measure fih defined below 



In the above display, h is a positive eigenmeasure associated with the top eigenvalue of the 
integral operator Q(x,dy) = G(x)M(x,dy) on 1^2(1^) (see for instance section 12.4 in [3]). 
This measure fih is in fact the invariant measure of the /i-process defined as the Markov 
chain X h with elementary Markov transitions M^(x,dy) oc M(x,dy)h(y). As the initiated 
reader would have certainly noticed, the above convergence result is only valid under some 
appropriate mixing conditions on the /i-process. The long time behavior of these /i-processes 
and their connections to various applications areas of probability, analysis, geometry and 
partial differential equations, have been the subject of countless papers for many years 
in applied probability. In our framework, using elementary manipulations, the Gaussian 
estimate given above can be used to calibrate the convergence of the particle estimate 

(F n ) towards [J-h{f)> as the pair of parameters TV" and n — > 00. 

The rest of this article is organized as follows: 

In section [21 we describe the mean field particle models used to design the particle 
approximation measures Q^. In section [3l we state the main results presented in this 
article, including a functional central limit theorem, and non asymptotic mean error bounds. 
Section [J] is dedicated to a key backward Markov chain representation of the measures Q n . 
The analysis of our particle approximations is provided in section [5] The final two sections, 
section [6] and section [7J are mainly concerned with the proof of the two main theorems 
presented in section [3l 

For the convenience of the reader, we end this introduction with some notation used 
in the present article. We denote respectively by Ai(E), and 13(E), the set of all finite 
signed measures on some measurable space (E,£), and the Banach space of all bounded and 
measurable functions / equipped with the uniform norm ||/||. We let n(f) = J fi(dx) f(x), 

1 Consult the last paragraph of this section for a statement of the notation used in this article. 
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be the Lebesgue integral of a function / £ B(E), with respect to a measure \i £ A4(i£). 
We recall that a bounded integral kernel M(x,dy) from a measurable space (E,£) into an 
auxiliary measurable space (E',£') is an operator / i— ► M(f) from B(E') into S(.E') such 
that the functions 

ihM(/)(i) := / M(x,dy)f(y) 
Je' 

are ^-measurable and bounded, for any / € B(E'). In the above displayed formulae, dy 
stands for an infinitesimal neighborhood of a point y in E' . The kernel M also generates 
a dual operator fj, h-> jiiM from A4(-E) into A^(-E') defined by (fiM)(f) := fj,(M(f)). A 
Markov kernel is a positive and bounded integral operator M with M(l) = 1. Given 
a pair of bounded integral operators (Mi,M2), we let (M1M2) the composition operator 
defined by (MxM2)(/) = Mi(M2(/)). For time homogenous state spaces, we denote by 
M m = M m ~ l M = MM m ~ l the m-th composition of a given bounded integral operator M, 
with m > 1. Given a positive function G on J5, we let : ^ £ P(-E) •— > ^dv) £ ~P(E), 
be the Boltzmann-Gibbs transformation defined by 

i£ G (ri)(dx) := —t—- G(x) r](dx) 



2 Description of the models 

The numerical approximation of the path-space distributions (11. ip requires extensive calcu- 
lations. The mean field particle interpretation of these models are based on the fact that 
the flow of the re-th time marginals rj n of the measures satisfy a non linear evolution 
equation of the following form 

Vn+l(dy) = J rj n (dx)K n+ltVn (x,dy) (2.1) 

for some collection of Markov transitions K n +x„, indexed by the time parameter n > 
and the set of probability measures V(E n ). The mean field particle interpretation of the 
nonlinear measure valued model (|2.1|) is the E^ -valued Markov chain 

Cn = (£ n > Cn' ■ • • > £n ) ^ 

with elementary transitions defined as 

N . JV 

P(£ n+1 £ dx I e„) = JJ i^ n+li< (e,^) with rfi:=-Y, % ( 2 " 2 ) 

i=i j=i 

In the above displayed formula, cfx stands for an infinitesimal neighborhood of the point 
x = (x 1 , . . . , 2; ) £ Efi+i' ^ ne initial system £0 consists of iV independent and identically 
distributed random variables with common law r/o- We let J-^ '■= cr (£0, . . . , £ n ) be the 
natural filtration associated with the iV-particle approximation model defined above. The 
resulting particle model coincides with a genetic type stochastic algorithm ~^ ~^ £ n+ i 
with selection transitions £ n ~~» £ n and mutation transitions £ n ~~» dictated by the 

potential (or fitness) functions G n and the Markov transitions M n+ \. 
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During the selection stage £ n £ n , for every index i, with a probability e n G n (£^), we 
set = otherwise we replace £^ with a new individual ^ = £n randomly chosen from 
the whole population with a probability proportional to G n {^ n ). The parameter e n > is 
a tuning parameter that must satisfy the constraint £ n Gn(£n) — 1> f° r ever y 1 < £ < -W. 
For e n = 0, the resulting proportional selection transition corresponds to the so-called 
simple genetic model. During the mutation stage, the selected particles £J, ~~> ^ , 1 evolve 
independently according to the Markov transitions M n+ \. 

If we interpret the selection transition as a birth and death process, then arises the 
important notion of the ancestral line of a current individual. More precisely, when a 
particle C n -\ — * £n evolves to a new location we can interpret C n -i as the parent of ^ % n . 
Looking backwards in time and recalling that the particle C n ~\ h &s selected a site £, J n _ 1 in 
the configuration at time in — 1), we can interpret this site as ^ ne P aren t of Cn-i ano - 
therefore as the ancestor denoted C n -i n a ^ l eve l ( n ~ 1) of d- Running backwards in time 
we may trace the whole ancestral line 



l.n 



(2.3) 



More interestingly, the occupation measure of the corresponding TV-genealogical tree model 
converges as N — > oo to the conditional distribution Q n . For any function F n on the path 
space £7[o,7i], we have the following convergence (to be stated precisely later) as N — > oo, 



1 * /■ 

J™ ]yE F n(&,n.£,n.---.&,n) = / 
j=l ^ 



i(rf(^o 5 • • • j x n )) F n (xo, . . . 



(2.4) 



This convergence result can be refined in various directions. Nevertheless, the asymptotic 
variance a^(F n ) of the above occupation measure around Q n increases quadratically with 
the final time horizon n for additive functions of the form 



F n (x , ...,X n )= ^2 fp( X p) a n( F n 
0<p<n 



~ n 



(2.5) 



with some collection of non negative functions f p on E p . To be more precise, let us examine a 
time homogeneous model (E n , f n , G n , M n ) = (E, /, G, M) with constant potential functions 
G n = 1 and mutation transitions M s.t. t]qM = rjo. For the choice of the tuning parameter 
e = 0, using the asymptotic variance formulae in [H eqn. (9.13), page 304 ], for any function 
/ s.t. r)o(f) = and r/o(/ 2 ) = 1 we prove that 



E E 

0<p<n 



£ M(«-rt+(f)(X q ) 

0<q<n 



with the positive part a+ = max (a, 0) and the convention M° = Id, the identity transition. 
For M(x,dy) = rjo(dy), we find that 



0<p<n 



E 

0<q<p 



(n + l)(n + 2)/2 



(2.6) 
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We further assume that the Markov transitions M„(x n _i, dx n ) are absolutely continuous 
with respect to some measures \ n {dx n ) on E n and we have 

(H) V(x n _i,x n ) e (E n -i x S n ) g n (g n -i,a; Tt ) = dMn ^~ 1 ' '_ ( Xw ) > q 

In this situation, we have the backward decomposition formula 

Q n (d(x , . . . ,x n )) =r] n {dx n ) M n {x n , d(x , . . . , x n -i)) (2.7) 
with the Markov transitions A4 n defined below 

n 

M n {x n ,d(x , . . . ,x n -i)) := n M <t,v q -A x qidx q -i) 

9=1 

In the above display, M n +i,r] is the collection of Markov transitions defined for any n > 
and rj G V(E n ) by 

1 

M n+lr ,(x,dy) = — G n (y) H n+1 (y,x) r]{dy) (2.8) 

7] (G n H n+1 (. , x)) 

A detailed proof of this formula and its extended version is provided in section HI 

Using the representation in (|2.7p . one natural way to approximate Q n is to replace the 
measures r\ n with their TV-particle approximations rj^ . The resulting particle approximation 
measures, Q^, is then 

(d(x , • • • , x n )) := ^ (dx n ) M% (x n , d(x , a?„_i)) (2.9) 

with the random transitions 

n 

(x n , d(x , := Yl (x q , dxq-i) (2.10) 

9=1 

At this point, it is convenient to recall that for any bounded measurable function f n on E n , 
the measures rj n can be written as follows: 



/ p \ 7n(/i 

7> 



^ with 7n (/ n ) := E / n (X n ) [] G P (X P ) j = Tfc(/„) r? p (G p ) 

n ^ V 0<p<n / 0<p<n 

(2-11) 

The multiplicative formula in the r.h.s. of (|2.11j) is easily checked using the fact that 
7 n+ l(l) = 7„(G n ) = rj n (G n ) 7n(l). Mimicking the above formulae, we set 

r! = Tsf(l)xQf with 7 ^(l):= J] r)p(G p ) and ^{dx) = >fi(l) X rff(dx) 

0<p<n 

Notice that the iV-particle approximation measures can be computed recursively 
with respect to the time parameter. For instance, for linear functionals of the form (|2 . 5f) . 
we have 

C(^n) = nZ(F?) 
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with a sequence of random functions on E n that can be computed "on-the-fly" according 
to the following recursion 

F n = £ Ke, • • • M P+ i,<] (/p) = /» + ^ (^0 

0<p<n 

with the initial value -F^ = fo- In contrast to the genealogical tree based particle model 
(|2.4p . this new particle algorithm requires N 2 computations instead of N, in the sense that: 

Vl< i < N F N (£i) = f (£>) + V ^-1(^-1)^(^-1.^) pN /« n 

This recursion can be straightforwardly extended to the case where we have f n (x n -i, x n ) 
instead of fn{x n ) in f|2.5|) as follows 

vi<i<iv F»(a)= y, ^-^-^"f- 1 ;® ^ (mc-l^+^o) 

l<j<Af 2^1<i'<7V tr n-l(.Sn-lJ-"n(,Sn-l'SnJ 

A very important application of this recursion is to parameter estimation for non-linear non- 
Gaussian state-space models. For instance, it may be used to implement an on-line version 
of the Expectation-Maximization algorithm as detailed in |13l Section 3.2]. In a different 
approach to recursive parameter estimation, an online particle algorithm is presented in 
|17j to compute the score for non- linear non-Gaussian state-space models. In fact, the 
algorithm of [T7j is actually implementing a special case of the above recursion and may be 
reinterpreted as an "on-the-fly" computation of the forward filtering backward smoothing 
estimate of an additive functional derived from Fisher's identity. 

The convergence analysis of the iV-particle measures towards their limiting value 
Q n , as N — > 00, is intimately related to the convergence of the flow of particle measures 
( r lp)o<p<n towards their limiting measures (rjp)o< p <n- Several estimates can be easily de- 
rived more or less directly from the convergence analysis of the particle occupation measures 
7]^ developed in [4], including L p -mean error bounds and exponential deviation estimates. 
It is clearly out of the scope of the present work to review all these consequences. One of 
the central objects in this analysis is the local sampling errors induced by the mean 
field particle transitions and defined by the following stochastic perturbation formula 

r£ = Vn-iK^ + -j= V n N (2.12) 



The fluctuation and the deviations of these centered random measures can be estimated 
using non asymptotic Kintchine's type L r -inequalities, as well as Hoeffding's or Bernstein's 
type exponential deviations [UEj. We also proved in [3] that these random perturbations 
behave asymptotically as Gaussian random perturbations. More precisely, for any fixed 
time horizon n > 0, the sequence of random fields converges in law, as the number of 
particles ./V tends to infinity, to a sequence of independent, Gaussian and centered random 
fields V n ; with, for any bounded function / on E n , and n > 0, 

nVn(ff) = [ Vn-iidx)K n>Vn _ 1 (x,dy)(f(y)-K n>rin _ 1 (f)(x)) 2 (2.13) 
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In section [5l we provide some key decompositions expressing the deviation of the particle 
measures (r^,Q^) around their limiting values (r n ,Q n ) in terms of these local random 
fields models. These decomposition can be used to derive almost directly some exponential 
and Lp-mean error bounds using the stochastic analysis developed in [3J. We shall use these 
functional central limit theorems and some of their variations in various places in the present 
article. 

3 Statement of some results 

In the present article, we have chosen to concentrate on functional central limit theorems, as 
well as on non asymptotic variance theorems in terms of the time horizon. To describe our 
results, it is necessary to introduce the following notation. Let (3{M) denote the Dobrushin 
coefficient of a Markov transition M from a measurable space E into another measurable 
space E' which defined by the following formula 

P(M) := sup {osc(M(/)) ; / G Osc^')} 

where Osci(-E') stands the set of ^'-measurable functions / with oscillation, denoted osc(/) = 
sup { | /(a;) — f(y)\ ; i,t/6 E }, less than or equal to 1. Some stochastic models discussed in 
the present article are based on sequences of random Markov transitions M N that depend 
on some mean field particle model with N random particles. In this case, (3{M N ) may 
fail to be measurable. For this type of models we shall use outer probability measures to 
integrate these quantities. For instance, the mean value E (@(M N )^ is to be understood 
as the infimum of the quantities K(B N ) where B N > j3(M N ) are measurable dominating 
functions. We also recall that 7 n satisfy the linear recursive equation 

In = l P Qp,n with Q p>n = Q p+1 Q p+2 . . . Q n and Q n (x, dy) = G n -x{x) M n (x, dy) 

for any < p < n. Using elementary manipulations, we also check that 

with the bounded integral operators D P:1l from E p into J5r 0jn ] defined below 
D Pjn {F n )(x p ) := / Mp(x p ,d(xo,...,x p -i))Q Ptn (xp,d(x p+ i,...,x n )) F n (x , . . . ,x n ) (3.1) 



with 

Qp,n(x p ,d(x p+ i,...,X n )) := Y[ Qq+l( x q,dXq+l) 

p<q<n 

We also let (G pn , P pn ) be the pair of potential functions and Markov transitions defined 
below 

G p , n = Qp,n{l)hpQ P ,niX) and P p , n (F n ) = D P:Tl (F n ) / D p , n {l) (3.2) 
Let the mapping <& p . n : V{E P ) — > V(E n ), < p < n, be defined as follows 

l^pQp,niX) 
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Our first main result is a functional central limit theorem for the pair of random fields 
on B(E\o n -\) defined below 

W^ N :=VN(T^-T n ) and W®> N := VW [Q^ - Q n ] 

Wn' N is centered in the sense that E (Wn' N (F n ) \ = for any F n G B(E^ >n ]). The proof of 
this surprising unbiasedness property can be found in corollary 15.31 i n section [5j 

The first main result of this article is the following multivariate fluctuation theorem. 

Theorem 3.1 We suppose that the following regularity condition is met for any n > 1 and 
for any pair of states (x, y) G (J3 n _i, E n ) 

(H + ) h-(y) <H n (x,y) <h+(y) with (h+/h~) eU(Vn) and h+ G L x (A n ) (3.3) 

In this situation, the sequence of random fields Wn' , resp. Wn' > converge in law, as 
N — > oo, to the centered Gaussian fields W£, resp. W„ , defined for any F n G B(E^ n j) by 

n 

w£(F n ) = £ 7P (1) V p (D Pjn (F n )) 

p=0 

n 

,n Pp,n{En Qra(-^n))) 

p=0 

The second main result of the article is the following non asymptotic theorem. 
Theorem 3.2 For any r > 1, n > 0, F n G B(E [0in] ) s.t. \\F n \\ < 1 

v^VE(|[Q^-Q„](F n )| r )"<a r £ £ n (3.4) 

0<p<n 

for some finite constants a r < oo whose values only depend on the parameter r, and a pair 
of constants (b P)n , c pn ) such that 

b p , n < sup (Q p>n (l)(x)/Q Pjn (l){y)) and c^ n < E {P(P£ n )) 

In the above display, P^ stands for the random Markov transitions defined as P p>n by 
replacing in Ii3.1\) and \3. I| ) the transitions A4 P by A4. p . For linear functionals of the form 
\2. 5\) . with f n G Osc\(E n ), the constant c p n in {3.$ can be chosen so that 

C P,n< E ^( M P,<_ 1 -" M 9 +1,<)+ E ( 3 - 5 ) 

with the Markov transitions S Pt<1 from E p into E q defined for any function f G B(E q ) by the 
following formula S p>q (f) = Q p ,q(f)/Q p , q (l). 
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We emphasize that the L r -mean error bounds described in the above theorem enter the 
stability properties of the semigroups S p q and the one associated with the backward Markov 
transitions M n+1 w. In several instances, the term in the r.h.s. of (|3.5p can be uniformly 
bounded with respect to the time horizon. For instance, in the toy example we discussed in 
(j2.6[) . we have the estimates 

i 

b p>n = l and c^ n < 1 => ViVE(|[Q^-Q„](F n )| r )" < a r (n + 1) 

In more general situations, these estimates are related to the stability properties of the 
Feynman-Kac semigroup. To simplify the presentation, let us suppose that the pair of 
potential-transitions (G n , M n ) are time homogeneous (G n , H n , M n ) = (G, H, M) and chosen 
so that the following regularity condition is satisfied 

(M) m V(x,x /2 G(x)<SG(x') and M m (x , dy) < p M m (x' , dy) (3.6) 

for some m > 1 and some parameters (5, p) £ [l,oo) 2 . Under this rather strong condition, 
we have 

b p , n <pd m and f3(S Ptq )<{l-p~ 2 5- m ) l{q - p)/ml 

See for instance corollary 4.3.3. in [3] and the more recent article [2j. On the other hand, 
let us suppose that 

inf (H(x,y)/H(x,y')) = a(h)>0 

x,y,y 

In this case, we have 

M n , v (x, dy) < a{h)~ 2 M niV (x', dy) =^ (3 (m^n^ . . . M q+l ^ < (l - a(hf) p ~ q 

For linear functional models of the form (|2.5p associated with functions f n E Osci(E n ), it 
is now readily checked that 

i 

VNe(\[Q% -®n](F n )\ r Y <a r b(n + l) (3.7) 



for some finite constant b < oo whose values do not depend on the time parameter n. With 
some information on the constants a r , these L r -mean error bounds can turned to uniform 
exponential estimates w.r.t. the time parameter for normalized additive functionals of the 
following form 

F-aixQi • • • ) x n) := ; T / fp{ x p) 

n + 1 

0<p<n 

To be more precise, by lemma 7.3.3 in [3], the collection of constants a r in (|3.7p can be 
chosen so that 

a 2 2 r r < (2r)! 2-' r /r\ and af r %\ < (2r + 1)! 2~ r /rl (3.8) 

In this situation, it is easily checked that for any e > 0, and N > 1, we have the following 
uniform Gaussian concentration estimates: 

llogsupp(|[Q^-Q n ](F n )| > -^= + e) < -e 2 /(2b 2 ) 

n>0 V V^V / 
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This result is a direct consequence of the fact that for any non negative random variable U 

Nr > 1 E(U r )r <a r b^j => logF (U >b + e)< -e 2 /(2b 2 ) 
To check this claim, we develop the exponential to prove that 

\ogE(e tu ) < 6t + ^ logP([/ > 6 + e) < -sup (et-^-) 
2 t>o V 2 / 

4 A backward Markov chain formulation 

This section is mainly concerned with the proof of the backward decomposition formula (|2.T|) . 
Before proceeding, we recall that the measures (j n ,Vn) satisfy the non linear equations 

7„ = "fn-lQn and r] n+1 := $ n+1 (r] n ) := ^ Gn (rj n )M n+1 

and their semigroups are given by 

In = l P Qp,n and rj n (f n ) := %Qp,n(/n)/%Qp,n(l) 

for any function f n £ B(E n ). In this connection, we also mention that the semigroup of the 
pair of measures (T n ,Q n ) defined in (II. ip for any < p < n and any F n £ B(E^ n y), we 
have 

T n {F n ) = lp D Pjn {F n ) and Q n (F n ) = r) p D Ptn (F n )/<n p D Ptn (l) (4.1) 
These formulae are a direct consequence of the following observation 

V P Dp,n( F n) = J Qp{d(x , . . .,x p )) Q Pt n(x p ,d(x p+1 , . . .,x n ))F n (x , ...,x n ) 

Lemma 4.1 For any < p < n, we have 

lp(dx p ) Q p<n (x p ,d(x p+ i,. . . ,x n )) =^ n (dx n ) M n;P (x n , d(x p , . . . ,x„-i)) (4.2) 

with 

Mn tP (x n ,d(x p ,...,x n -i)):= ][ M q+ i iVq (x q+1 , dx q ) 

p<q<n 

In particular, for any time n > 0, the Feynman-Kac path measures (Q) n defined in ^1. jj) can 
be expressed in terms of the sequence of marginal measures (f? p )o<p<n; with the following 
backward Markov chain formulation 

Q n (d(x , x n )) = r] n (dx n ) M nfi (x n , d(x , . . . , x n _i)) : (4.3) 

Before entering into the details of the proof of this lemma, we mention that (|4,3p holds 
true for any well defined Markov transition M n+ i^ n (y, dx) from E n into E n+ \ satisfying the 
local backward equation 

^G n (r]n)(dx) M n+1 (x,dy) = ^ n+1 (r] n )(dy) M n+ i i??n (y, dx) 
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or equivalently 

rj n (dx) Q n+ i(x,dy) = (rj n Q n+ i)(dy) M n+1>Vn (y,dx) (4.4) 
In other words, we have the duality formula 

*gM (/ M n+1 {g)) = $ n+1 (77n) {9 M n+1)Vn (f)) (4-5) 

Also notice that for any pair of measures fi, v on E n s.t. /j, <C v, we have fiM n+ \ <C 
i/M n +i. Indeed, if we have ^M n _|_i(^4) = 0, the function M n +i(l^) is null i^-almost every- 
where, and therefore /x-almost everywhere from which we conclude that /xM n +i(A) = 0. For 
any bounded measurable function g on E n we set 

^ 9 Gn (7] n )(dx) = y Gn (ri n ){dx) g(x) < ^ G „(??n)(^) 

^From the previous discussion, we have ^ G (r] n )M n+ i <C 1 ^ , G! ri (r; n )M n -(-i and it is easily 
checked that 

d^r (r) n )M n+ i 

is a well defined Markov transition from -E^+i into £7 n satisfying the desired backward 
equation. These manipulations are rather classical in the literature on Markov chains (see 
for instance [18], and references therein). Under the regularity condition {H) the above 
transition is explicitly given by the formula f|2.8j) . 

Now, we come to the proof of lemma 14.11 

Proof of lemma I4.lt 

We prove f)4.2f) using a backward induction on the parameter p. By (14. jj) , the formula 
is clearly true for p = (n — 1). Suppose the result has been proved at rank p. Since we have 

— l,n (■%>— 1) d\Xp 1 • • • , 3?ri)) 

— Tp— 1 ydxp— i) Qp^Xp—i, dxp) Qp^ni^pi d(xp-\-\, • • • ,£c n )) 

and 

7 p _i(da;p_i) Q p (xp- 1 ,dx p ) = j p (dx p ) Mp^^Xp, dx v -\) 

Using the backward induction we conclude that the desired formula is also met at rank 
(p — 1). The second assertion is a direct consequence of (I4.2p . The end of the proof of the 
lemma is now completed. ■ 



We end this section with some properties of backward Markov transitions associated 
with a given initial probability measure that may differ from the one associated with the 
Feynman-Kac measures. These mathematical objects appear in a natural way in the analysis 
of the iV-particle approximation transitions M.^ introduced in (I2.10|) . 

Definition 4.2 For any < p < n and any probability measure r] £ V(E p ), we denote by 
Ai n +l,p,r) the Markov transition from E n+ \ into -E^n] = {Ep x . . . x E n ) defined by 

Mn+l,p, v {x n+ x,d(x p ,...,X n ))= Y\ M q+l,$ p , q (r])( X Q+li dx q) 

p<q<n 
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Notice that this definition is consistent with the definition of the Markov transitions 
M p ,n introduced in lemma B~H 

Mn+l,p, Vp (x n +i,d(x p , ... , x n )) = M n +i, p (x n+ i,d(x p , ... , x n )) 

Also observe that Ai n+ i )P)V can alternatively be defined by the pair of recursions 

■^^n+l,p,r) O^n+l? d^Xp, . . . , X n )) 

= ^n+l, P +l,Vi())) {x n+1 ,d{x p+ i,...,x n )) x Mp + i^(xp+i,dxp) (4.6) 

= -^n+l,<E> Pin (»)) (•£«.+ 1 ? dx n ) J^n,p,ri {%m d(d£p, . . . , X n — l)) 

The proof of the following lemma follows the same lines of arguments as the ones used in 
the proof of lemma 14. 11 For the convenience of the reader, the details of this proof are 
postponed to the appendix. 

Lemma 4.3 For any < p < n and any probability measure n £ V{E V }, we have 

vQpjTiidxn) jVf nj p j? ^(x n , d(xp, . . . , x n — i)) — rji^dxp) Qp in (xp, ci(xp^i, . . . , 
In other words, we have 

J^n,p,ri{,Xni d{Xp, . . . , 

(V X Qp,n-l)(d(x p , . . . ))G n _i(x n _i) 



(4.7) 



(vQp,n-l) {Gn-1 

ura£/i i/ie measure (ij x Q P;n _i) defined below 

{V x Qp,„-i)(d(x p , . . . ,x n -i)) := f](dx p ) Qp,n-i(xp,d(x p+ i, . . . ,x n -i)) 

5 Particle approximation models 

We provide in this section some preliminary results on the convergence of the iV-particle 
measures (r^,Q^) to their limiting values (r n ,Q n ), as N —> oo. Most of the forthcoming 
analysis is developed in terms of the following integral operators. 



Definition 5.1 For any < p < n, we let D pn be the T^^-measurable integral operat 
from S(£ , [o ) „]) into B(E p ) defined below 

D p,n( F n){x P ) ■= J Mp (x p ,d(x , ■ ■ ■ ,X p -i))Qp t n(Xp,d(x p+ i, . . .,x n ))F n (x , ...,x n ) 

with the conventions D^ n = Qo,n, and resp. D^ n = M.„, for p = 0, and resp. p = n 
The main result of this section is the following theorem. 



ors 
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Theorem 5.2 For any < p < n, and any function F n on the path space Er ^ n i, we have 

n 

E [T»{F n ) | F») = $ « n (F n )) and W^ N (F n ) = V p N [D^ n (F n )) 

p=0 

Proof of theorem 15. 2t 

To prove the first assertion, we use a backward induction on the parameter p. For p = n, 
the result is immediate since we have 

r%(F n )= 1 »(l)r ] »{D» n (F n )) 

We suppose that the formula is valid at a given rank p < n. In this situation, we have 

= 7f-i(i) I^IGh^-^HW^W (5-1) 

Using the fact that 

Jp-i(l) Vp-i(G P -iH p (.,x p )) \p{dx p ) M p v N_^(x v ,dx p -i) = j£_ 1 (dx p -.i)Q p (x p - 1 , dx p ) 
we conclude that the r.h.s. term in (15. ip takes the form 

J "f p _ 1 (dx p _ 1 )M p y _ 1 (x p _ 1 ,d(x , . . . ,Xp-2))Qp-l,n(xp-i,d(x p , . . .,x n )) F n (x , ... ,x n ) 

This ends the proof of the first assertion. The proof of the second assertion is based on the 
following decomposition 

n 

[T»-T n )(F n ) = ^[E(r^(F n )|^)-E(r^(F„)|^ 1 )] 

p=0 

= E^(l) (V (Cft)) - y ^ , <-l W-l,n(Fn)) 

P =o V Vp-i(^P-i) 

where J-^ 1 is the trivial sigma field. By definition of the random fields V p N , it remains to 
prove that 

To check this formula, we use the decomposition 

r^_ x {dx p -\) M p y _ 1 (x p ^ 1 ,d(x ,. . .,Xp- 2 )) Qp-i,n(xp-i,d(x p , . . .,x n )) 

(5.2) 

= rj p v _ 1 (dxp-i)Qp(xp-i,dxp)M p _ 1 (x p -i,d(x , . . . ,x p - 2 )) Qp,n(x P , d(x p+ i, . . .,i n )) 
Using the fact that 

•qp_ 1 {dxp-{)Qp{xp-i,dxp) = (r] p -iQp)(dx p ) M^N^Xp, dx p -\) 
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we conclude that the term in the r.h.s. of (|5.2p is equal to 

(r]^_ 1 Qp)(dxp) Mp (x p , d(x , . . . , x p _i)) Qp, n (x p , d(x p+1 , . 
This ends the proof of the theorem. 



Several consequences of theorem 15.21 are now emphasized. On the one hand, using the 
fact that the random fields are centered given •Fn—\'> ws find that 

E(r%(F n ))=T n (F n ) 

On the other hand, using the fact that 

7p(1) _ 7 P (1) 1 



7n(i) ipQpA 1 ) VpQpA 1 ) 

we prove the following decomposition 



W L /\F n ) = VN{^(1) Q^-Q n ) (F n ) = £t?(1) V p N (< n (F n ; 

p=0 



with the pair of parameters (7^ (1), D^ n \ defined below 



7^(1):="^ and D^ n {F n 

7n. 1 F 



7^(1) 



D pn (F n ) 



7.(1) P ' nV 7 %Q P ,n(l) 

Using again the fact that the random fields are centered given F^-i, we have 



i(wr(K) 2 )=E E «(i) 2 E 

p=0 



£> P ,„(F„) 1^ 



Using the estimates 



\\D^ n (F n )\\ < \\Q p , n (l)\\ \\F n \\ 

\Dp,n( F n)\\ < IIQ P ,„(1)I| ll^nll with Q p>n (l) = 



(5.3) 



(5.4) 



(5.5) 



we prove the non asymptotic variance estimate 

n n 

E(W r n ' N (F n ) 2 )<Y,^(lpa) 2 ) ||Q p , n (l)|| 2 = ^[l + E([7^(l)-l] 2 )] ||Q p>n (l) 
p=0 p=0 

for any function F n such that \\F n \\ < 1. On the other hand, using the decomposition 

W(l) Qn " Qn) = W(l) -l] Qn + (Qn " Qn) 

we prove that 



V[[®n(Fn)-®n(F n )Y 



- ^E«(F n ) 2 ) 1/2 +E([7^(l)-l] 



1/2 
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Some interesting bias estimates can also be obtained using the fact that 

E (Qn (i*n)) - Qn{F n ) = E ([l — 7n (1)] [Q^(F n ) - Q n (F n )] ) 

and the following easily proved upper bound 

1/2 _ 



|E (Q% (F n )) - Q n (F n )\ < E ([l - 7n (!)] 2 ) E ( [Q? (F n ) - Q n (F n )] 2 ) 

Under the regularity condition (M) m stated in (|3,6p . we proved in a recent article [2], 
that for any n > p > 0, and any iV > (n + l)/^" 1 we have 



||Q p , n (l)|| <S m p and iVE^7; v (l)-l) j < A (n + 1) p 5 m 
/,From these estimates, we readily prove the following corollary. 

Corollary 5.3 Assume that condition (M) m is satisfied for some parameters (m,6,p). In 
this situation, for any n > p > 0, any F n such that \\F n \\ < 1, and any N > (n + l)p5 m we 
have 



Z ( W T n ' N (F n )) =0 and E ( W^ N (F n ) 2 ) < (8 m pf(n + 1) ( 1 + 1 pi V" ( „ + 2 



/n addition, we have 

NE^(F n ) 

and the bias estimate 

N\E(Q"(F n ))- 



.(Fn)] 2 ) < 2{n + l)p5 m U + P 5 



i{F n )\ < 2V2 (n + l) P 5 m [A + pS 



l + -(n + 2) 



l + -(n + 2) 



1/2 



6 Fluctuation properties 

This section is mainly concerned with the proof of theorem 13.11 Unless otherwise is stated, 
in the further developments of this section, we assume that the regularity condition (H + ) 
presented in (|3.3p is satisfied for some collection of functions (h~,h^). Our first step to 
establish theorem 13. II is the fluctuation analysis of the iV-particle measures (r^,Q^) given 
in proposition 16.21 whose proof relies on the following technical lemma. 

Lemma 6.1 

M% (x n , d(x , x n -i)) - M n (x n , d(x , x n _i)) 



E [ M n,P,4 



M 



0<p<n 



n, P M<-l) 



(x n , d(x p , . . . , x n -i)) Mp (x p , d(x , . . . , x p -i)) 



The proof of this lemma follows elementary but rather tedious calculations; thus it is 
postponed to the appendix. We now state proposition 16.21 
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Proposition 6.2 For any N > 1, < p < n, x p € E p , m > 1, and F n G £>(i^ 0jn ]) such 
that \\F n \\ < 1, we have 



/, , x 2 



iVE(|^„(F n )-Z) Pin (F n )(x p )| m ) m <a(m) 6(n) (^r(^)) (6-1) 



for some finite constants a(m) < oo, resp. b(n) < oo, whose values only depend on the 
parameters m, resp. on the time horizon n. 

Proof: 



Using lemma 16.11 we find that 

D» n {F n ) - D p , n {F n ) = £ [M p>qj< - M mM< _ i: 



L p,q,n 



0<q<p 



with the random function T^ q n (F n ) defined below 



Fp.q jn {F n )(Xq, . . . , x p ) 



■= J Q p ,n(x p ,d(x p+1 ,..., x n )) M%(x q ,d(x ,...,x q -i)) F n (x ,. . . ,x n ) 
Using formula (|4.7p . we prove that for any m > 1 and any function F on E< qiP \ 



N E 



(F) (x p 



N \ m 



9-1 



< a(m) b{n) \\F\\ -^(x 



for some finite constants o(m) < oo and b(n) < oo whose values only depend on the pa- 
rameters m and n. Using these almost sure estimates, we easily prove (|6.ip . This ends the 
proof of the proposition. ■ 



Now, we come to the proof of theorem 13.11 
Proof of theorem I3.lt 

Using theorem 15. 2} we have the decomposition 

n 

Wl' N {F n ) =£^(1) V P N (D p , n (F n )) + R r n ' N (F n ) 
with the second order remainder term 

n 

R r n > N (F n ) := £ 7 f(l) V p N (Fg n ) and the function F p N n := [D» n - D p , n ](F n ) 

By Slutsky's lemma and by the continuous mapping theorem it clearly suffices to check that 
Rn (F n ) converge to 0, in probability, as N — » oo. To prove this claim, we notice that 
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On the other hand, we have 

M<-i)(ra 2 ) 

= JX p (dx p ) * Gp _i (Vp-i) (H p (.,x p )) F p N n (x p ) 2 

<V P ({F p N n ) 2 )+ J \{dx p ) \[*g p ^[v?-i)-*g p ^(Vp-i)](H p (.,x p ))\ F p N Jx p f 



This yields the rather crude estimate 

, 2 



M<-l)((<ny 
= J\ p {dx p ) ^Gp-i (H p (.,x p )) F p N n (x p ) 2 

< *b (( F p N n) 2 ) +4||Q p ,„(l)|| 2 f \ p (dx p ) |[¥ Gj ^ - * Gp _ a (#„(., S p ))| 



from which we conclude that 



<Jr, p (dx p )E[(F^ n (x p )y 

+4||Q P) n(l)|| 2 / Ap((iXp) E(|[^g p _i -*G,-x fap-l)] *p))| 

We can establish that 

>/jV E (| [^Gp-i «x) - ^Gp-i (Vp-i)} (H p (.,x p ))\) < b(n) h+{x p ) 
See for instance section 7.4.3, theorem 7.4.4 in [3J. Using proposition 16.21 



E (y» (F p N n ) 2 ) < c(n) ri P ((0)') + X p (h+)^ 

for some finite constant c(n) < do. The end of the proof of the first assertion now follows 
standard computations. To prove the second assertion, we use the following decomposition 

7^(1) 



N [Q» -® n ](F n ) = = w —W n > (F n -Q n (F n )) 



— r jv 

with the random fields W n ' defined in (|5.3p . We complete the proof using the fact that 
7^ (1) tends to 1, almost surely, as N — > oo. This ends the proof of the theorem. ■ 

We end this section with some comments on the asymptotic variance associated to the 
Gaussian fields W$. Using (|4.ip . we prove that 
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with the pair of integral operators (D p>n , P p>n ) from B(E^ 0n j) into B{E p ) 

7=) (zp \ Dp,n{Fn) _ D Pin {\) F>p,n{F n ) 

Dp ' n(Fn) - ^qui) " pA n) PpAFn) --^M 

from which we deduce the following formula 

D p , n (F n - Q n (F n ))(x p ) 

= D Ptn (l)(x p ) J [P p , n (F n )(x p ) - Pp,n(F n )(yp)] % p ,„(i) (ri P )(dy p ) 



(6.2) 



Under condition (M) m , for any function F n with oscillations osc(F n ) < 1, we prove the 
following estimate 

n 

\\D p , n (l)\\<5 m p^E(w®(F n ) 2 ) < (5 m p) 2 Y,P(P P ,n) 2 

p=0 

7 Non asymptotic estimates 

This section is mainly concerned with the proof of theorem 13.21 We follow the same semi- 
group techniques as the ones we used in section 7.4.3 in [4J to derive uniform estimates w.r.t. 
the time parameter for the iV-particle measures tj^ . We use the decomposition 



\{fn) 2^ I r,N D N (I) N D N M\ I 



— Mni^n) = 

0<p< 



with the conventions r]_ 1 D_ 1 n = ??oQo,n) for p = 0. Next, we observe that 

= J rj p y _ 1 (dx p - 1 )M p v _ l (x p - 1 ,d(x , . . . ,x p -2))Qp-i,n(xp-i,d(x p , . . .,x n ))F n (x , ...,x n ) 

= I Vp-i(dxp-i)Qp(x p -i,dxp) 

xM^^Xp-i^ixo, ■ ■ ■ ,x p - 2 ))Qp,n( x pid(x p+ i, . . .,x n ))F n (x , ...,x n ) 
On the other hand, we have 

r}p_ x {dxp-i)Qp(xp-i y dxp) = r} p _ 1 Q p {dx p ) M p ^N_ x {x p , dx p -i) 
from which we conclude that 

rg-iDS-^m = (v^-iQp)(D^ n (F n )) 
This yields the decomposition 



(7.1) 
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with the convention $0(^-1) = %) f° r p = 0. If we set 



~ N = _ ^(<-l)Kn(^n)) 



then every term in the r.h.s. of (|7,ip takes the following form 

Vp Dp,n( p,n) VpQp,n(X) 



iV ^7^ v 



with the integral operators -D„ v n defined in (|5.4|) . Next, we observe that D pn (l) = Q Pt7l (l), 



and D pn (T) = D p>n (l). Thus, in terms of the local sampling random fields V p , we have 
proved that 

piN ( fpN \ -1 1 

Hp ^p^K^pju) _ 1 ^ 1 v N ~n N (f n ) 



and 



DZ >n (F n ) = D p , n (l) X P£ n (F n ) with P^(F n ):=-^-^ 



(7.2) 
(7.3) 



;,From these observations, we prove that 



*<?„,„(!) ( $ P«-l)) ^n(^n) 



5 A f 



W-i)(QpM) 



Arguing as in (|6.2p we obtain the following decomposition 

D Ptn (F pn )(x p ) 

= D p>n (l)(x p )xJ [P p N n (F n )(x p ) - P p N n (F n )(y p )} * Qpi „( 1) ($ P «_ 1 ))(^) 
and therefore 



^n(^) < /9(i^„) 0SC(F„) With b p , n < SU P 



Qp,n(l)('^p) 



Q P ,n(i)(y P ) 

We end the proof of (|3.4p using the fact that for any r > 1, p > 0, / G B(E p ) s.t. osc(/) < 1 
we have the almost sure Kintchine type inequality 



E(K(/)| r I 

for some finite (non random) constants a r < 00 whose values only depend on r. Indeed, 
using the fact that each term in the sum of (|7.ip takes the form (17. 2p we prove that 



JV E 



MF n )\ r y <o(r) £ 6} |B E(oBc(jg,(F B ))) 

0<p<n 
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This ends the proof of the first assertion (|3.4p of theorem 13.21 For linear functionals of the 
form (|2.5p . it is easily checked that 



D% n (F n ) = Q Pin (l) £ [M m N_ i ...M q+li< ](f q )+ QpMqQqM) 



0<9<P p<q<n 



with the convention M p , q N j . . . M p+1 ^N = Id, the identity operator, for q = p. Recalling 
that Dp n (l) = Q Pj n(l), we conclude that 

Qp,q{Qq,n{^) fq) 



and therefore 



0<g<p " p<«j<n ^(^M 1 )) 

Q Plg (Q g ,n(l) /g) = S p , q (Q qin (l) fq) . , „ / n _ Qp,g(g) 

with the potential functions Q q ^ n (l) defined in (15, 5p . After some elementary computations, 
we obtain the following estimates 

osc(P^(F n )) 

< Ea<q<pP ( M p,^_ 1 • • • M ?+l,<) OSC (/g) + Ep<q<n h \n P(Sp,q) OSc(/ g ) 

This ends the proof of the second assertion (|3.5p of theorem 13. 2[ 

Appendix 

Proof of lemma 14.31 

We prove the lemma by induction on the parameter n(> p). For n = p + 1, we have 

■Mp+i tPt r)(x p +i, dx p ) = Mp + i, n {xp + i,dxp) and Q p , p +i{x p , dx p+ \) = Q p +i(x p , dx p+ i) 
By definition of the transitions M p+ i^, we have 

r]Q p+ i{dx p+ i) M p+ i jPjr ,(x p+1 ,dXp) = rj(dx p ) Q PjP+1 (x p ,dx p+1 ) 
We suppose that the result has been proved at rank n. In this situation, we notice that 
r)(dx p ) Q Pin+ i(x p , d(x p+ i, x n+l )) 

= Tj(dXp) Q Pj n{x p , . . . , x n ))Qn+l(x n ,dx n+ i) 

VQp,n\dXji) Qn+\{%m dx n j r \) ■^ // ^n,p,ri{^m d(X p) . . . , £C n _i)j 
= VQp,n{l) $p,n(v)(dXn) Qn+l(x n , dx n+1 ) M n>p>71 {x n , d(x p , . . . , X n -l)) 
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Using the fact that 

®p,n(v)(dx n ) Qn+i(x n ,dx n+ i) = ^ p , n (v)Qn+i(dx n +i) M n+1)4p ^ (x n+ i , dx n ) 

and 

r)Q Pi „(l) $ Pjn (r))Q n+1 (dx n+1 ) = i]Qp, n+ i{dx n+l ) 

we conclude that 

rj(dx p ) Qp,n+i(x p , d(x p+ i, x n+1 )) 

= vQp,n+i(dx n+1 ) M n+1 ^ vn ^(x n+ i i dXn) JV[n,p,ri{Xni 

d(x p , . . . ,x n -i)) 

= VQp,n+l{dx n+ i) M n +l,p,ri {.Xn+1 ) d(Xp, . . . , 3?n)) 

This ends the proof of the lemma. 

Proof of lemma 16.1b 

Using the recursions (|4.6|) . we prove that 

■M-n+ipflN (x n+ i,d(x p , . . . , X n )) 

= ^nti lP +i,i p+ i«) {x n+1 ,d{x p+ i, . . .,x n )) x M p+1>v N(x p+ i,dx p ) 
On the other hand, we also have 

Mp +1 (x p+ i,d(x , ■ ■ -,x p )) = M p+ltV N(x p+ i,dx p )Mp (x p ,d(x , . . . ,%-i)) 
from which we conclude that 

M n+l,p+l,$ p+1 ( V ») (Xn+l,d(x p+1 , X n )) M* +1 (x p+1 , d(x , X p )) 

= K+l Mp " (x n+ i,d(x p , x n )) Mp (x p , d(x , Xp-i)) 
The end of the proof is now a direct consequence of the following decomposition 
M%(x n ,d(x ,. . . 

j X n —\ 

)) - Mn(x n ,d(x , . . .,2 n -l)) 
= X/l<p<n -^n.p.ri^ \ x ni d{x p , . . . , X n -\ ))M*{Xp,d(x ,...,X p _i)) 



-M 



",P-1,<_1 ( X n,d(x p -i, . . . ,X n _i)) M^_ l {x p ^i,d(x , ...,X p 



) X n — 1 

)) - M n ,o, Vo (x n , d(x , x n -i)) 

with the conventions 

M n)0 ,, » (x n , d(x , x n _i)) Mq (x , d(x , • • • , xt)) = M nQn N (x n , d(x , £ n _] 
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for p = 0, and for p = n 

■M- n , n ,r$ (x n , d(x n , x n -i)) Mn (x n , d(x , x n -i) = M% (x n , d(x , X n -l) 
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